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SEARCH-EFFICIENT MIMO TRELLIS DECODER 

BACKGROUND OF THE INVENTION 
[01] The present invention relates to digital communication, and more particularly to trellis 
5 coding used with multiple-input multiple output communication systems. 

[02] Demand for wireless digital communication and data processing systems is on the 
rise. Inherent in most digital communication channels are errors introduced when 
transferring frames, packets or cells containing data. Such errors are often caused by 
electrical interference or thermal noise. Data transmission error rates depend, in part, on the 

10 medium which carries the data. Typical bit error rates for copper based data transmission 
systems are in the order of 10" 6 . Optical fibers have typical bit error rates of 10" 9 or less. 
Wireless transmission systems, on the other hand, may have error rates of 10" 3 or higher. The 
relatively high bit error rates of wireless transmission systems pose certain difficulties in 
encoding and decoding of data transmitted via such systems. Partly because of its 

1 5 mathematical tractability and partly because of its application to a broad class of physical 

communication channels, the additive white Gaussian noise (AWGN) model is often used to 
characterize the noise in most communication channels. 

[03] Data is often encoded at the transmitter, in a controlled manner, to include 
redundancy. The redundancy is subsequently used by the receiver to overcome the noise and 

20 interference introduced in the data while being transmitted through the channel. For 

example, the transmitter might encode k bits with n bits where n is greater than k, according 
to some coding scheme. The amount of redundancy introduced by the encoding of the data is 
determined by the ratio n/k, the inverse of which is referred to as the code rate. Codewords 
representing the n-bit sequences are generated by an encoder and delivered to a modulator 

25 that interfaces with the communication channel. The modulator maps each received 

sequence into a symbol. In M-ary signaling, the modulator maps each n-bit sequence into 
one of M= 2 n symbols. Data in other than binary form might be encoded, but typically data is 
representable by a binary digit sequence. 

[04] To gain bandwidth efficiency and coding, Trellis Coded Modulation (TCM) has been 
30 developed and combines a multilevel phase modulation signaling set with a trellis coding 
scheme. TCM increases the minimum Euclidean distance between pairs of coded signals to 
reduce the loss from the expansion of signal set and to achieve coding gain with relatively 



relatively simple codes. The TCM is described, e.g., in Ungerboeck, "Trellis-Coded 
Modulation with Redundant Signal Sets Part I," IEEE Communications Magazine, Vol. 25, 
February 1987; and in Ungerboeck, "Trellis-Coded Modulation with Redundant Signal Sets 
Part II," IEEE Communications Magazine, Vol. 25, February 1987, both of which are 
5 incorporated herein by reference for all purposes. 

[05] At the receiving end of a transmission channel, the coded symbols must be decoded. 
The Viterbi algorithm is an efficient maximum-likelihood sequence detection method for 
decoding convolutional and trellis coded symbols transmitted over AWGN channels. The 
Viterbi algorithm is described in a number of publications. See for example, Viterbi, "Error 

10 Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm", 
IEEE Trans, on Information Theory, Vol. IT-13, April 1967; G. D. Forney, Jr., "Maximum- 
Likelihood Sequence Detection in the Presence of Intersymbol Interference" IEEE Trans, on 
Information Theory, Vol. IT-18, pp. 363-378, May 1972; and G. D. Forney, Jr., "The Viterbi 
Algorithm", IEEE Proceedings, Vol. 61, pp. 268-278, March 1973, all of which are 

15 incorporated herein by reference for all purposes. 

[06] In accordance with the Viterbi algorithm, for each received signal, a distance between 
that signal at time ti and all the trellis paths entering each state at time tj is calculated. In the 
Viterbi algorithm, the minimum Euclidean distance is selected as the optimum branch metric 
for decoding convolutional and trellis sequences transmitted in AWGN channels. 

20 [07] To increase the data rate and the operating range without increasing the bandwidth, 
multiple input multiple output (MIMO) systems have been developed. In a MIMO system, 
the transmitter includes multiple transmit antennas and the receiver includes multiple receive 
antennas. The transmitter splits the data to be transmitted into a number of streams (typically 
bit streams) and transmits the streams via the multiple transmit antennas. The receiver 

25 receives the transmitted streams via the multiple receive antennas. The labeling convention 
used herein for alphanumeric symbols represents scaler quantities as italic symbols, vectors 
as lowercase bold symbols, and matrices as uppercase bold symbols. Unless otherwise 
indicated, it is understood that each scaler quantity, vector component or matrix element can 
be a complex number. 

30 [08] Fig. 1 is a simplified block diagram of a prior art MIMO TCM encoder 10. TCM 
encoder 10 includes a serial-to-parallel converter 12, a convolutional encoder 14, a symbol 
mapper 16 and a serial-to-parallel converter 18. The MIMO system (not shown) of which 
MIMO TCM encoder 10 is a part, includes M t transmit antennas and M r receive antennas (not 
shown). The channel through which the data encoded by TCM encoder 10 is transmitted is 
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characterized by the complex matrix H having the dimensions of M t x M r . The channel is 
assumed to be an AWGN channel. Convolutional encoder 14 in conjunction with symbol 
mapper 14 perform the TCM encoding. 

[09] Unencoded data bit streams arrive at serial-to-parallel converter 12 (hereinbelow 
5 referred to alternatively as converter 12). Out of every u+k bits that serially arrive at 

converter 12, u bits are delivered in parallel to symbol mapper 16 and k bits are delivered in 
parallel to convolutional encoder 14. The k-bits are encoded by convolutional encoder 14 
which has a code rate of k/n. Symbol mapper 16 uses the n encoded bits to select one of 2" 
cosets of symbols, each having 2 U labels. Symbol mapper 16 then uses the u unencoded bits 

10 to select one of the 2 U labels from the selected coset. Each label so selected is a complex 

number having a real and an imaginary component. Serial-to-parallel converter 18 converts 
the serial bit streams associated with each selected label to M t parallel bits, which are 
transmitted by the corresponding M t transmit antennas. Accordingly, each transmitted vector 
y has M t complex components. Each received vector r has the dimension of M r and is 

1 5 represented by the following expression: 

r = Hy + v 

where v is the noise and/or interference vector which is assumed to have a spatial auto- 

20 covariance matrix. 

[10] Fig. 2 is a simplified block diagram of a prior art MIMO TCM decoder 30 that is 
adapted to decode the data encoded by TCM encoder 10 after this data is transmitted. MIMO 
TCM decoder 30 includes a Logarithmic Maximum A Posteriori (Log-MAP) decoder 30, a 
Viterbi trellis decoder 34, a selector 36 and a parallel-to-serial converter 38. Log-MAP 

25 decoder 32 is supplied with the received vector r and the channel matrix H and, in response, 
generates an estimate for each of the transmitted symbols; this estimate is also referred to as a 
soft decision of the decoded symbol. In particular, Log-MAP decoder 32 finds the Euclidean 
distance between the received vector r and the nearest label in each coset for one antenna by 
searching over all other possible transmitted labels on the other M t -1 antennas and does this 

30 for each antenna. For each coset j, for all possible labels in coset j and for each transmit 

antenna i, Log-MAP decoder 32 computes a distance metric d(ij) and a corresponding label 
metric label(ij), as shown below: 
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d(i,j) = min (r - HX(*))" A" 1 (r - HX(kj) (1) 
label{U j) = arg min (r - HX(*))" A _1 (r- HX(*)) (2) 

k 

In the above equations (1) and (2): 

H : is the channel estimate matrix, 

A" 1 : is the inverse of the auto-covariance matrix of any of the antennas, 
X : is a M t by CL matrix of the possible transmitted symbol combinations 
on all the M t antennas, where C=2 n is the number of cosets, and L=2 U 
is the number of labels in each coset. 
X(k) : represents all rows of matrix X that have an element of coset k in their 
ith column. 

[11] Metrics d(ij) and label(i J) so computed are supplied to Viterbi (trellis) decoder 34 
and selector 36, respectively. Viterbi decoder 34 assigns the same distance d(ij) to all edges 
in the trellis that generate an output with elements from coset j. The metrics d(ij) and 
label(ij) corresponding to each transmit antenna i are applied to associated transitions of the 
trellis. For instance, the distance and label metrics associated with transmit antenna 1 are 
applied to the following transitions in the trellis: 

0, M t , 2 M t . . . 

Similarly, the distances and label metrics associated with transmit antenna 2 are applied to 
the following transitions in the trellis: 

25 l,M t +l,2M t +l,... 

[12] Viterbi decoder 34 identifies the most likely k unencoded bits received by converter 
12 (see Fig. 1) and the corresponding coset for each channel instance. The most likely coset 
returned from Viterbi decoder 34 is supplied to selector 36. Using the cosets received from 
30 Viterbi decoder 34, selector 36 identifies the most likely u unencoded bits and the 

corresponding labels for each channel instance. Parallel-to-serial converter 38 receives the bit 
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streams associated with the cosets and labels in parallel-as identified by Viterbi decoder 34 
and selector 36— and serializes these bit streams at its output terminals. 

[13] Prior art decoder 30 performs p =2 (u+n) * Mt searches to identify the transmitted symbols 
at the receiving end. As the number of constellation signals (i.e., the symbol set) increases, 
5 the number of searches required to identify the transmitted symbols increases by a large 

factor. It would be desirable to have a decoder adapted to perform fewer searches to identify 
the transmitted symbols than conventional decoders. 

BRIEF SUMMARY OF THE INVENTION 
10 [14] In accordance with the present invention, a decoder generates one or more metrics 
associated with each symbol of a symbol coset transmitted in a multi-input multi-output 
communication system having M t transmit antennas and M r receive antennas by performing 
on the order of 2 (u+n)(Mt ~ 1) searches, where n is the number of encoded bits used to select one 
of 2 n cosets at the transmitting end and u is the number of unencoded bits used to select one 
15 of 2 U symbols at the transmitting end, for each of the M t antennas. The metrics are 
subsequently used by a Viterbi decoder to identify the coset and their corresponding 
transmitted symbols. 

[15] To perform the above search, the decoder receives vector r of the received symbols- 
received on the M r receive antennas— and a channel matrix H having M t rows and M r 

20 columns to characterize the channel between the M t transmit antennas and the M v receive 
antennas. Next, the decoder forms a vector quantity xopt t representing an optimized guess 
for the symbol transmitted by a first one of the transmit antennas and whose elements are 
defined by a combination of a first column h, of matrix H , the remaining columns H n ^ of 
matrix H and a matrix X of possible symbols transmitted on the remaining transmit 

25 antennas. Matrix X thus includes (M t -1) rows and 2 u+n columns. The decoder then uses the 
vector quantity xoptj to compute a distance metric and a label metric associated with each of 
the remaining transmit antennas. Next, the decoder forms another vector quantity xopt 2 
representing another optimized guess associated with a second one of thelransmit antennas. 
Accordingly, vector quantity xopt 2 includes elements defined by a combination of a second 

30 column h 2 of matrix H , the remaining columns H n;t2 of matrix H , and matrix X . The 
decoder uses the vector quantity xopt 2 to compute a distance metric and a label metric 
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associated with the first transmit antenna. The first and second antennas could be any pair of 
transmit antennas. 

[16] In one embodiment, the vector quantities xopt, and xopt 2 are computed using the 
following equations: 



xopt, = 



h;h, 



xopt 2 = 



A-(h;r-h' 2 H n , 2 X) 



h 2 h 2 



10 where vector h,* is the complex conjugate transpose of vector h, , and vector h 2 * is the 

complex conjugate transpose of vector h 2 . The distance metric associated with each, except 
the first, transmit antenna is computed using the following equation: 

1 5 d{i, j) = min(r - h, xopt ,(k) - H „„ X(k))" A" 1 (r - h, xopt, (k) - H , #1 X(kj) 

k 

where h, is the 1 st column of Matrix H , H n;tl are all but the remaining columns of matrix 
H , A" 1 is the auto-covariance of any of the transmit antennas, X(k) represents all rows of 
20 matrix X which have an element of coset k in their i th column, and xopt, (k) represents those 
elements of vector xopt, that belong to coset k. The label metric associated with each, except 
the first, transmit antenna is computed using the following equation: 

25 label{ij) = arg min (r - h.xopt, (k) - H n ^X(k))" A" 1 (r - h, xopt, (k) - H„„X(/r)) 



The distance and label metrics associated with the first transmit antenna are respectively 
obtained using the following equations: 



d(l,j) = min(r - h 2 xopt#) - H„, 2 X(k))" A"'(r- h 2 xopt 2 (k) - H„„ 2 X(£)) 

k 

label{\J) = argmin (r -h 2 xopt 2 (£) - H„, 2 X(£))" A^r-h^opt^-H^X^)) 

k 

5 [17] The decoder then supplies the distance and label metrics associated with each transmit 
antenna to a Viterbi decoder which, in response, identifies the received symbols. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[18] Fig. 1 is a simplified block diagram of a MIMO TCM encoder, as known in the prior 
10 art. 

[19] Fig. 2 is a simplified block diagram of a MIMO TCM decoder, as known in the prior 
art. 

[20] Fig. 3 is a simplified block diagram of a MIMO TCM decoder including a search- 
efficient Log-MAP decoder, in accordance with one embodiment of the present invention. 

15 

DETAILED DESCRIPTION OF THE INVENTION 
[21] Fig. 3 is a simplified block diagram of a MIMO TCM decoder 50, in accordance with 
one embodiment of the present invention. MIMO TCM decoder 50 includes, in part, a 
search-efficient Log-MAP decoder 52, a Viterbi decoder 54, a selector 56 and a parallel-to- 
20 serial converter 58. MIMO TCM decoder 50 is adapted to decode symbols encoded via, for 
example, the prior art encoder shown in Fig. 1, and transmitted via a channel with a 
characteristic estimate matrix H. 

[22] At the transmitting end (not shown), out of every u+k bits, k-bits are encoded by a 
convolutional encoder that has a code rate of k/n. The n encoded bits are used to select one 

25 of 2 n cosets, each having two 2 U labels. The u unencoded bits are subsequently used to select 
one of the 2 U labels from the selected coset. Each label so selected is a complex number 
having a real and an imaginary component. The serial bit stream associated with each 
selected label is converted to M t parallel bits, and is subsequently transmitted by the 
corresponding M t transmit antennas. 

30 [23] In the following, it is assumed that encoded data are transmitted on M t transmit 

antennas and are received on M r receive antennas. Therefore, each transmitted symbol vector 
y has M t complex components. It is further assumed that each received vector symbol r has 
the dimension of M r and is represented by the following expression: 
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r = Hy + v 



where v is the noise and/or interference vector which is assumed to have a spatial auto- 
5 co variance matrix. 

[24] In accordance with the present invention, search-efficient Log-MAP decoder 52 
performs p=2 (u+n) * (Mt ~ 1) searches to determine a distance metric (alternatively referred to 
hereinbelow as a distance) and a label metric (alternatively referred to hereinbelow as a label) 
associated with each transmitted symbol. The search results are subsequently supplied to 

10 Viterbi decoder 54 and selector 56, as part of the label decoding process. For each transmit 
antenna, a set of associated distances and labels are computed for each m th channel instance 
given the channel estimates H(m) (alternatively referred to hereinbelow as H) and the 
received vector r(m) (alternatively referred to hereinbelow as r). A channel instance is 
associated with one of the M t transmit antennas and one of the M r receive antennas, so the 

1 5 M th channel instance is one of M t x M r channel instances. To make this computation for each 
transmit antenna, the effects of the other M r l antennas are first removed, as described further 
below. 

[25] First, one of the transmit antennas (e.g., the first transmit antenna) is selected from the 
linear array of M t transmit antennas, to form an associated intermediate vector quantity. It is 
20 understood that any one of the M t transmit antennas could be selected as the first transmit 

antenna. An associated intermediate vector quantity xopti is computed for the first transmit 
antenna as follows: 



25 where: 



30 



l l : 



H 



X: 



xoptj = 



A' 1 (hjr-hX^X) ' 

h;h, 



is the first column of channel estimate matrix H, 
are the remaining columns of H, 

is the inverse of the auto-covariance matrix of any of the 
transmit antennas, 

is a (M r l) by CL matrix of the p possible transmitted symbol 
combinations on the M r l other antennas, where C=2 n is the 
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number of cosets, and L=2 U is the number of labels in each 
coset. 

[26] It is understood that any one of the M t transmit antennas may be selected to form the 
5 intermediate variable, as described above. Therefore, it is understood that the selection of the 
first transmit antenna to form the intermediate variable xopt, , in accordance with the above, 
does not imply a constraint to some canonicalization of physical antennas. 
[27] The distance between the received vector r and the nearest label in each coset is 
determined for each antenna by searching over all other possible transmit symbols sets on the 
10 other M r 2 antennas with xopt! representing the most likely sequence transmitted on the first 
antenna. In other words, for each transmit antenna i (i is an integer varying from 1 to M t ), 
except the first transmit antenna (i.e., i=l) for all L possible labels in each coset j, a distance 
d(i 9 j) is calculated as shown below: 

15 d(ij) = min(r - h^opt,^) - H^X(*))" A" 1 (r - h 1 xopt 1 (k) - H„,X(i)) 

where: 

X(k) : represents all rows of matrix X which have an element 

of coset k in their i th column, 
20 xopt! (k) : represents those elements of vector xopti that belong to 

coset k. 

[28] Edges in the trellis that generate an output with elements from coset j, can be assigned 
25 the same distance d(i 9 j) . The distances are computed for each of the other transmit antennas, 
i=2,. . .M t . Next, using the channel estimates H and r, the corresponding labels are computed 
for each edge in the trellis decoder, as shown below: 

labels j) = argmin (r - h 1 xopt I (k) - H n ^X(k))" A' 1 (r - h.xopt, (k) - H n ^X(k)) 

k 

30 

[29] Following the computation of the distance metrics d(ij) for all possible labels L in 
each coset j for each antenna i^l and after the corresponding labels label(ij) are determined 
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15 



20 



25 



for each antenna the distance metric associated with the first antenna is determined by 
removing the effects of another antenna (e.g., i=2) and repeating the above computations. In 
other words, after distance metrics d(i,j) and label metrics label(ij) are determined for each 
antenna if 1 for all L possible labels in each coset j, the following vector quantity is 
calculated: 



xopt 2 = 



A -1 (h>-h^H^x) 



h 2 h 2 



Vector quantity xopt 2 is subsequently used in computing the distances and labels associated 
1 0 with the first antenna and coset j, as shown below: 



d{\,j) = min(r - h 2 xopt 2 f£) - H„ <2 X(£))" A'' (r - h 2 xopt 2 (k) - H„ #2 X(£)) 

k 

labels j) = argmin (r - h 2 xopt 2 (k) - H„, 2 X(£))" A" 1 (r - h 2 xopt 2 (k) - H^ 2 X(£)) 



[30] The distances d(ij) and labels label (ij) corresponding to each transmit antenna are 
applied to associated transitions of the trellis. For instance, the distances and labels associated 
with the first transmit antenna (i.e., i=l) are applied to the following trellis transitions: 

0, M t ,2 M t ... 

Similarly, the distances and labels associated with the second transmit antenna (i.e., \=2) are 
applied to the following trellis transitions: 

1, M t +l,2 M t +1,... 



[31] Viterbi decoder 54 receives the distances d(ij) and labels label(ij) generated by 
search-efficient Log-MAP 52. In response, Viterbi decoder 54 identifies the most likely 
30 transmitted coset. Using the cosets identified by Viterbi decoder 54 and the labels generated 
by search-efficient LOG-MAP 52, selector 54 selects the transmitted label belonging to coset 
identified by Viterbi decoder 54. Parallel-to-serial converter 58 receives the cosets and label 
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streams supplied by Viterbi decoder 54 and selector 56 in parallel. In response, parallel-to- 
serial converter 58 supplies these streams serially at its output terminals. 
[32] As seen from the above equations, the reduced LOG-MAP decoder, in accordance 
with the present invention, performs 2 (u+n)(M t " 1) searches in order to identify the most likely 
5 coset and the most likely transmitted label from the identified coset. 

[33] It is understood that search-efficient Log-MAP decoder 52, in accordance with the 
present invention, may be implemented by software code executed by a central processing 
unit, by dedicated hardware or by a combination of hardware and software. 
[34] The above embodiments of the present invention are illustrative and not limitative. 

10 The invention is not limited by the number of deployed transmit or receive antennas. The 
invention is not limited by the number of cosets or the number of labels within each coset. 
For example, the present invention would also work where M t or M r falls to one or is set to 
one (effectively resulting in a SIMO or MISO system) or a system with M r =l at the outset, 
although the improvement over an exhaustive search might be less than with a MIMO 

15 system. The invention is not limited by the number of bits used to select a coset or the 
number of bits used to select a label from a coset. Other additions, subtractions or 
modifications are obvious in view of the present invention and are intended to fall within the 
scope of the appended claims. 
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